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SOME STRONG LIMIT THEOREMS FOR THE LARGEST 
ENTRIES OF SAMPLE CORRELATION MATRICES 

By Deli Li^ and Andrew Rosalsky 

Lakehead University and University of Florida 

Let {Xjc^i'ji > l,fc > 1} be an array of i.i.d. random variables and 
let {pn;n > 1} be a sequence of positive integers such that n/pn is 
bounded away from and oo. For Wn — maxi<i<j<p„ | X]fc=i ^k,iXk,j\ 
and L„ = maxi<i<j<p^ \Pi"j\ where p'"' denotes the Pearson corre- 
lation coefficient between . . . and (Xij , . . . , X„,j)', the 
limit laws (i) lim„_oo = a.s. (a > 1/2), (ii) lim„^oo n}^" Ln = 
a.s. (1/2 < a < 1), (iii) lim„^oo — 2 a.s. and (iv) 

y/ n log n 

lim„^oo (i3^)^''^in = 2 a.s. are shown to hold under optimal sets of 
conditions. These results follow from some general theorems proved 
for arrays of i.i.d. two-dimensional random vectors. The converses of 
the limit laws (i) and (iii) are also established. The current work was 
inspired by Jiang's study of the asymptotic behavior of the largest 
entries of sample correlation matrices. 

1. Introduction. At the origin of the current investigation is the statisti- 
cal hypothesis testing problem studied by Jiang [7] using the asymptotic dis- 
tribution of the largest entry of a sample correlation matrix. Jiang's [7] work 
will now be discussed. Consider a p-variate population {p > 2) represented 
by a random vector X = {Xi, . . . , Xp) with unknown mean /x = . . . , /Xp), 
unknown covariance matrix 5] and unknown correlation coefficient matrix 
R. Let A^n,p = (-'^fe,j)i<fc<n,i<j<p be an n X p matrix whose rows are an ob- 
served random sample of size n from the X population; that is, the rows 
of j^n,p are independent copies of X. Jiang [7] assumed that both n and 
p are large; more precisely, Jiang [7] assumed that, for some < 7 < oo, 
P = Pn ^ 7^ as n — > cx). In contradistinction to classical multivariate data 
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analysis wherein the dimension p is fixed (see, e.g., Anderson [2]), in con- 
temporary multivariate data analysis the dimension p can be very large and 
can vary with n and be comparable with n (see, e.g., Donoho [5] and John- 
stone [8] who fittingly illustrate this point with many examples comprising 
a diversity of applications). 

When both n and p are large, Jiang [7] considered the statistical test with 
null hypothesis Hq : R = I, where I is the p x p identity matrix. In general, 
this null hypothesis asserts that the components of X = (Xi, . . . ,Xp) are 
uncorrelated whereas when X has a p-variate normal distribution, this null 
hypothesis asserts that these components are independent. 

Jiang's [7] test statistic is extremely intuitive and will now be described. 

Let n > 2. Set xj^^^ = J2k=i ^k,i/i^, 1 < ^ < Let X^-"^ denote the ith column 
of M.n,p, 1 < i < p, let e = (1, . . . , 1)' G TZ^ and let || • || be the Euclidean norm 
in TZ^. Jiang's [7] test is based on the test statistic 

(1-1) ^ri = ^jn-ax^ \ptj\^ 



where 



l<i<j<p 



(L2) 



(Xf ) - ^e)'(x5") - Xj'^e) 
~ ||xS")-Xf^e||-||xf^-#e|| 
is the Pearson correlation coefficient between the ith and jth columns of 

Mn,p- 

Jiang [7] proved the following two limit theorems concerning the test 
statistic L„ when p = Pn and M = {Xk^i;i > 1, A; > 1} is an array of inde- 
pendent and identically distributed (i.i.d.) random variables. Theorem 1.1 
provides a law of the logarithm (LL) for L„, and Theorem 1.2 establishes the 
asymptotic distribution of -L„. The limiting distribution in Theorem 1.2 is 
a type-I extreme value distribution. 

Theorem 1.1 ([7]). Suppose that < oo for all < r < 30. // 

lim.„_oo ^ = 7 G (0, oo), then 

lim ( I L„ = 2 almost surely (a.s.). 

n^oo \ log n J 



Theorem 1.2 ([7]). Suppose that E\Xi^iY < oo for some r > 30. // 
lim^^oo ^ = 7 G (0, oo), then 

lim Pinht — 41ogn -|- log log n <t) = expi ^=e~*''^l, 

n^oo y 72V87r J 

— oo < t < oo. 



STRONG LIMIT THEOREMS FOR LARGEST ENTRIES 



3 



Let R„ = {Pij )i<i,j<p„ be the Pn x p.„ sample correlation matrix obtained 
from M.n,p„ = • • • ) Xp"^ ) . As was discussed by Jiang [7], by shifting 

(n) 

and scaling each column X- of Aln,p„, the new data matrix and pn 
have the same sample correlation matrix R„ . Thus if the population is Pn- 
variate normal, under the null hypothesis that the Pn components of X are 
independent, the distribution of R„ is the same as that generated by a data 
matrix composed of i.i.d. A^(0, 1) random variables. Jiang [7] thus obtained 
the following corollary of Theorems 1.1 and 1.2. 

Corollary 1.1 ([7]). Let M = {Xf:^i;i > l,fc > 1} be an array of in- 
dependent random variables where X^^i ~ N{fii,af),i >l,k>l where af > 
0, i > 1 . Let the sample correlation matrix R„ be obtained from M.n,p„ = 
{XkXi 1 < ^ < Pn, 1 < < n},n > 1 where {pn',n >1} is a sequence of pos- 
itive integers satisfying lim„^oo ^ = 76 (0,cxd). Then the conclusions of 
Theorems 1.1 and 1.2 prevail. 

In the current work, the main results are Kolmogorov-Marcinkiewicz- 
Zygmund-type strong laws of large numbers (SLLNs) (Theorems 2.1 and 2.2) 
as well as LLs (Theorems 2.3 and 2.4) for both {Wn',n > 1} and {L^, n>l} 
where 

(1.3) Wn = max 

Note that J2k=i^k,tXk,j is the (i,j)th entry of M'r,^p^Mn,p„, l<i,j < 
n,n> 1. In Theorems 2.1 and 2.3 the conditions are also shown to be nec- 
essary. (As in Theorems 1.1 and 1.2, the array A4 = {Xk^i',i > l,fc > 1} is 
composed of i.i.d. random variables.) We prove in Theorem 2.4 that Theo- 
rem 1.1 holds under substantially weaker moment conditions and the con- 
dition lim^^oo ^ = 7 S (0, 00) is weakened as well. More specifically, the 
hypotheses of Theorem 2.4 will be satisfied if < 00 and n/p.„ is 

bounded away from and 00; lim„_^oo — does not need to exist. 

The main tools employed by Jiang [7] in proving Theorem 1.1 are (i) a 
result of Amosova [1] on probabilities of moderate deviations which sharpens 
a result of Rubin and Sethuraman [12], and (ii) a special case of Theorem 1 
of [3] which is, in turn, a special case of the Chen-Stein Poisson approxima- 
tion method. In the current work, we use quite a few results from classical 
probability theory and a recent generalization of the IIoffmann-j0rgensen 
[6] inequalities due to Li and Rosalsky [10]. 

The plan of the paper is as follows. Theorems 2.1-2.4 will be stated in 
Section 2 but their proofs will be deferred until Section 4. In Section 3, 
three very general results (Theorems 3.1-3.3) will be established concerning 



n 

E 

fc=i 



XkAXk' 



n>l. 
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arrays of i.i.d. two-dimensional random vectors. These results are of interest 
in their own right but the last two of them will be used in Section 4 to prove 
Theorems 2.1-2.4. 



2. The main results. Throughout, let A4 = {X^ j; i > 1, A; > 1} be an ar- 
ray of i.i.d. random variables, let {pn',n' > 1} be a sequence of positive inte- 
gers, and for n > 1, consider the nxpn matrix Mn,p„ as defined in Section 1. 

Let p["j be defined as in (1.2), 1 < i,i < n, n > 1. Let {Ln;n > 1} be as in 
(1.1) with p = Pn and let {Wn;n > 1} be as in (1.3). 

The first theorem is a Kolmogorov-Marcinkiewicz-Zygmund-type SLLN 
for {Wn;n>l}. 

Theorem 2.1. Suppose that n/pn is bounded away from and oo. Let 
a > 1/2. Then 

(2.1) lim — = a.s. 

n— >oo n°' 

if and only if 

(2.2) P( max \XiXi\>nA<oo 



n=l 



and 



EXi = whenever a < 1. 
Here and below Xi = Xi^i,i > 1. 

Remark 2.1. Note that 



P{ max \XiXA>n°'] <n^P{\XiX2\>n°'), n>l 

\l<i<j<n J 

and so (2.2) holds if 

oo 
n=l 

which is equivalent to £;|XiX2p/" < oo. Thus, (2.2) holds if E\Xxf^'^ < oo. 
Also note that 

p( max \XiXj\ > nA A -P{\XiX2\ > n°) 

\l<i<j<n J 2 



>P[ max |XjXr„/2]+i|>n° 

\l<i<n/2 ^ ' ' 

>l-exp|-|p(|XiX2| >n°)|, n>2 
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and hence since 1 — ~ x as x ^ 0, 



n=2 

if and only if 



^nP{\XiX2\ > n") < cx) 



n=l 



which is equivalent to S|XiX2p/" < oo. Thus ^jXip/" < oo if (2.2) holds. 

The second theorem is a Kolmogorov-Marcinkiewicz-Zygmund-type SLLN 
for {-L„;n > 1}. 

Theorem 2.2. Suppose that n/pn is bounded away from and oo. Let 
1/2 < a <1. If Xi^i is nondegenerate and (2.2) holds, then 



(2.3) lim n^~"L„ = a.s. 

n—foo 

The third theorem establishes a LL for {Wn',n > 1}. 

Theorem 2.3. Suppose that n/pn is bounded away from and oo. Then 

(2.4) lim =2 a.s. 

n->oo -y/nlogn 

z/ and on/|/ i/ 

(2.5) = 0, SX? = 1 and Y p( max > y^nlogn] < oo. 

^1 Vi<i<i<" ^ / 

Remark 2.2. By an argument similar to that in Remark 2.1, the con- 
dition 

(2.6) P( max \XiXA > Vnlogri^ < oo 
is weaker than the condition 

K oo.(f;ixli))3 )<- 

but stronger than the condition 
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Let hi{t) = E{Xfl{\Xi\ <t)) and h2it) = E{Xfl{\Xi\ <t)),t>0. Then, by 
using Fubini's theorem, we can see that (2.7) and (2.8) are, respectively, 
equivalent to 

/ Xfhi{\Xi\) ^ 
%lo,ie+\X,\)Y^<^ 



and 



'^[{log{e + \X^\)y)^°^- 
Remark 2.3. Note that 

PI max \XiXj\ > ^/nlogn ] = P{Zn:iZn:2 > \/n\ogn), 

\l<i<j<n J 

where Zn: \ and Zn:2 are, respectively, the largest and the second largest of 
the random variables \X\\, \^2\i • • • i \^n\- Thus (2.6) is equivalent to 

oo 

(2.9) 5]P(Z„;iZ„:2> V^^l^)<oo. 

n=l 

Clearly, 

P(^n: l^n:2 > ^ n\ogn) > P{Zl,2> V^logn) 

= P{Zn:2>{n\ognf/^), n>l. 
Let tn = P{\Xi\ > (nlogn)i/^),n > 1. Then (2.6) implies that 

oo 

E^(^-:2>(nlogn)i/4) 

n=l 

oo 

= Y^{l-{l-tr,T-ntn{l-tnT-^) 
n=l 

< OO 

and hence (2.6) implies that ntn = o(l). These two consequences of (2.6) 
entail 

oo oo 

(2.10) ^'^n = E ^'(^(l^il > (nlogn)V4))2 ^ ^_ 

n=l n=l 

It follows from the Cauchy-Schwarz inequality and (2.10) that 

oo 1/2 

^^log(n + l) 

(oo \ 1/2 / oo \ 1/2 

E 1 2, [Y.^\P(\X^\>{n\ognfl')f\ <oo 

^^nlog{n + l)J J 
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and hence (2.6) ensures that 

E\Xif <oo for all < /3 < 6. 

The fourth theorem estabhshes a LL for {L„;?i > 1}. 

Theorem 2.4. Suppose that n/pn is hounded away from and oo. If 
Xi is nondegenerate and (2.6) holds, then 

( n 

(2.11) hm Ln = 'l a.s. 

3. Three general results. In this section three very general results will 
be established. Theorems 3.2 and 3.3 will be used in Section 4 to prove the 
four theorems in Section 2. 

Let {{Uk,i, Vk^i);i > 1, > 1} be an array of i.i.d. two-dimensional random 
vectors. Let {pn',n > 1} be a sequence of positive integers and consider the 
n X pn matrices 

A„ = {Uk,i)l<k<n,l<i<p„, B„ = {Vk^i)l<k<n,l<i<pn, 71 > 1. 

Then A^B„ is a p„ x p„ matrix whose (i,j)th entry is J2k=i Uk,iVkj,n > 1. 
Let 



Tn = max 



X! Uk,iVk,i , n> 1. 

k=l 

Let {Yn;n > 1} be a sequence of i.i.d. random variables where Yi has the 
same distribution as C/i,iVi,2 and set Sn = J2k=i^k,n' > 1- 

Theorem 3.1 may now be presented. It is a very general result wherein 
the asymptotic fluctuation behavior of T„ is governed by a Baum-Katz-Lai- 
type complete convergence result. It is not assumed that n/pn is bounded 
away from and oo. 

Theorem 3.1. Let {an;n> 1} be a sequence of positive constants such 
that a„, I oo and 

(3.1) limlimsup — = 1. 

Suppose that the sequence {pn]n> 1} is nondecreasing. If 

(3.2) 

and 

2 / 1 C I \ 

(3.3) y^P(^>A)<oo for some 0<X<oo, 

^1 n V a„ J 
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then 
(3.4) 



limsup — <A a.s. 



Proof. Let 5 > he arbitrary. By (3.1), we can choose c > 1 such that 
(3.5) ajcn] < (1 + S)an for all large n. 

Note that for all large n 



max Tm = max max 



< max max 



k=l 
m 



k=l 



= Hn (say) 

and hence for all large n 

p( max Zk> (1 + 35)2 a") 

Vc"-l<m<c" Cm / 

<p(^>{l + 'i8)\] [by (3.5)] 



< (p[cni)Vf max ^ > (1 + 3<5)a) 



Note that (3.2) ensures that 



and 



lim min P(5„, — Sk> — 5Aa„,) = 1 

n^ool<fc<n 



lim min P(S'„ — S'/t < (5Aa„) = 1. 

n-»ool<fc<n 



It then follows from Theorem 2.3 of [11] that for all large n 



(3.6) 



P I max 



>(1 + 3<5)2a) 



IS, 



<2(p[,„])^P(^>(l + 25)A). 



He"] 



Again recalling (3.2), for all large n and m G [[c"], [c"^"^] — 1], another appli- 
cation of Theorem 2.3 of [11] yields 

Pf^>(l + 2<^)A 
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(3.7) <p( max ^>(1 + 25)a) 

V[c"]<i<m a[cn] / 

<2P( ^^ + ^^^'^"^1 > (1 + S)X) [by (3.5)] 

V a[c"+i] y 

V Om / 

Since [c"+i] - [c"] ~ ^([0*"+^] - 1), it follows from (3.6) and (3.7) that for 
all large n 

p( max —> (1 + 3(5)2 A 



< 



4(P[c"]) 



,E!:"4ym>gm|/fl>n>A) 



.+11 _ 1 



Then by (3.3) and the Borel-Cantelli lemma, 

p( max — > (1 + 35)2A i.o. (?i) 



whence 



limsup — < (1 + 3(5)2A a.s. 

n— »oo flji 



Since (5 > is arbitrary, the conclusion (3.4) is established. □ 

Consider the sequence of partial sums {Sn',n > 1} defined prior to the 
statement of Theorem 3.1. Let /? > and a > 1/2, and assume that EYi = 
if a <1. According to the celebrated theorem of Baum and Katz [4], the 
following are equivalent: 

^n^^-^Pi ^-^>e] < 00 foralle>0, 



n=l 
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oo . I <? I \ 

n^/^-ip sup ^ > e < oo for all e > 0, 

n—l \m>n / 

(3.8) £;|yi|(2/3+i)/" < oo. 

Note that (3.8) is equivalent to 

(3.9) £;|C/i,i|(2/^+i)/"<oo and < oo 
and that EYi = is equivalent to 

(3.10) {EUi,i){EVi,i) = 0. 

Combining Theorem 3.1 and the Baum-Katz [4] theorem yields the follow- 
ing. 

Corollary 3.1. Let a > 1/2 and /3 > 0. Suppose that (3.9) holds and 
ifoi<l that (3.10) holds. Then 

maxi<j^ <„/3 |Efc=i^fe,jV'fcj| 
lim ~ = a.s. 

n— >oo fi^^ 

Proof. Let a„ = n" and pn = [n^],n > 1. Then (3.1) is immediate and 
(3.3) holds for all A > by the Baum-Katz [4] theorem. It follows from (3.8) 
that i^lyil^/" < oo whence by the Kolmogorov-Marcinkiewicz-Zygmund 
SLLN, (3.2) holds. Thus (3.4) holds for aU A > by Theorem 3.1. Since 
A > is arbitrary, the corollary is proved. □ 

Again consider the sequence of partial sums {Sn',n > 1} defined prior to 
the statement of Theorem 3.1 and let /? > 0. By a theorem of Lai [9], 



oo 



yn^P-^p{^^^>\]<oo foranA>2x/^ 



n log n 

(3.11) ^^1 = 0,^^1^ = 1 and E[- — ) < oo. 



n=2 

if 

I 1 4/3+2 



,(log(e + |yi|))2/3+i. 
Combining Theorem 3.1 and Lai's [9] theorem yields the following. 

Corollary 3.2. Let /3 > and suppose that 

{EUi,i){EVi,i)=0, {EUl^){EVl^) = 1 

and 
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Then 



maxi<j^ •<„^ I J2k=i Uk,iVkj\ ^ „ /-J 

lim sup ~ _ < 2 V P 

n^oo ^/nlogn 



a.s. 



Proof. Set ai = 1, = ^/n\ogn,n > 2 andp„ = [n^],n > 1. Then (3.1) 
is immediate. Note that (3.12) and (3.11) are equivalent. The first two con- 
ditions of (3.11) and Chebyshev's inequality ensure that (3.2) holds. Now 
(3.3) holds for all A > 2^/]3 by Lai's [9] theorem. Thus by Theorem 3.1, 

lim sup < A a.s. for all A > 2\/]3. 

n^oo \/n log n 

The conclusion follows by letting A | 2\f^. □ 

Throughout the rest of this section, it is not being assumed that {j)n\ n > 
1} is monotone. 

Theorem 3.2. Suppose that n/pn is bounded away from and oo. Let 
a > 1/2. Then 



Tn 

lim — = 

n— ♦oo fi^i 



a.s. 



(3.13) 

if and only if 
(3.14) 
and 

{EUi^i){EVij) = whenever a <1. 
Theorem 3.3. Suppose that n/pn is bounded away from and oo. If 



n=l 



VP( max |[/iiVL,| >n" I <oo 
^ \l<i^i<n' ' / 



and 
(3.15) 

then 
(3.16) 

Conversely, if 
(3.17) 



(i^f/i,i)(i?yi,i) = 0, {EUl,){EVl,) = 1 
max |C/i,jVij| > \/nlogn ) < oo. 



n=l 



1- 

iim sup —== 

n^oo log n 



< 2 a.s. 



lim sup ■ 



< CXD 



a.s., 



n^oo \J n log n 

then (S[/i,i)(EVi,i) = 0, {EUl^){EV^-i)<oo and (3.15) holds. 
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For the proofs of Theorems 3.2 and 3.3 we need the following two lemmas. 

Lemma 3.1. Let {an',n >1} be a nondecreasing sequence of positive con- 
stants such that 

liman+i/a„ = l and limini a2n/an = b £ (l,oo]. 

n— >oo n-^oo 

Then, for every c > and q>\, the following statements are equivalent: 

(3.18) P{ max i^i ,1 > < oo, 

(3.19) y^-P( max |C/i,iVij| > ea„ ) < cx) foralle>0, 

n=l \ - rj— / 

(3.20) > -P max max \Um iVm i\ > £a!„n] ] < oo foralle>0. 

^ \l<m<q"l<i=/=j<cm ' '■' V 
n=l \ - — - / 

Proof. We only give the proof of the equivalence of (3.18) and (3.19) 
since the proof of the equivalence of (3.18) and (3.20) is similar. To show 
that (3.19) implies (3.18), note that 

4 4 



^(i^S^i'o \Ui,iyi,3\>ean) <5m^(., max |C/i,iyij|>ea„ 

<y'y'-P max >ea„ 



= 16P max \Ui^iVij\ > eOn 

where h = {m;{{k - l)/2)cn < m < {k/2)cn}, A; = 1,2, 3, 4. Thus (3.19) im- 
plies that 

(3.21) y]-P( max \Ui^iVi A > ean] < oo for ah e > 0. 



Let be a positive integer such that T^c > 1. By repeating v — \ times the 
above procedure for arriving at (3.21), we get 



(3.22) V P\ max \U\,i\^\,i\ > ea„ < oo for ah e > 0. 

n=l \ - - / 

Thus the proof that (3.19) implies (3.18) is complete. 
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We now prove that (3.18) implies (3.19). Under (3.18), we can use the 
same idea for arriving at (3.21) to get 

(3.23) y"p( max |C/i jVi ,1 > < oo. 

Let bi £ (1,6). Then since a„ < a2n~i/bi < a2n/bi for ah large n, it is easy 
to see that (3.23) implies 

Vp( max iC/i.jVi,,-! > (l/fei)a„ ) < oo. 

n=l \ - - / 

By iterating this technique we get 

(3.24) Vpf max \Ui^iVij\ > (l/biYan) < oo for = 1, 2, 3, . . . . 



n=l 



Since lim^^oo(l/6i)" = 0, (3.19) with c = 1 follows from (3.24). Thus (3.22) 
with c = 1 and arbitrary v>l holds, and from this we get that (3.19) holds 
for every c > 0. □ 

Lemma 3.2. Suppose that n/pn is bounded away from and oo. Let 
{a„;n> 1} be as in Lemma 3.1. If 



Tn 

lim sup — < oo 

n— >oo On 



(3.25) iimsup— <oo a.s., 

then (3.18) holds and {EUi^i){EVi^i) = whenever limn-,oo CLn/n = 0. 



Proof. Since n/pn is bounded away from and oo, there exists a con- 
stant c > 1 such that c~^n < Pn ^ cn,n > 1. Then it follows from (3.25) 
that 



maxi<j^ xc-in I Y.k=i Uk,iVkj\ 
limsup ~ < oo 



On 



Since lim^^oo On+i/on = 1, 



maxi<j^ xc-in I J2k=i Uk,iyk,j\ 
limsup ■ — < oo 

ri— »oo On 



Note that 



max \Un+i,iVn+ij\ < max 



+ max 

l<j7^j<c~^n 



k=l 
n+1 



a.s. 



a.s. 



k=l 



n > 1. 
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We then have 

hmsup ~ < oo a.s. 

n— >oo Cln 

Then since the random vectors in the array ^ ^ 1) ^ ^ 1} are i.i.d., 

it follows from the Borel-Cantelli lemma that 

P{ max \Ui iVi j\ > Aa„ ) < oo for some A > 0. 

^ \l<iJ.j<c-^n ' / 
n=l \ — — / 

Using the same argument as in the proof of Lemma 3.1, we have 



n=l 



max \Ui^iVij \ >dn] < oo, 

\-<ij^j<'n 



where a„ = Aa„, n > 1. In view of Lemma 3.1, (3.18) follows. If 
lim„^oo o-n/'^ = 0, then (3.25) implies that 

lim ■ — = a.s. 

n — ^oo 72 

and hence by the Kolmogorov SLLN, {EUi^i){EVi^i) = {EUi^i){EVi^2) = 0; 
the proof of Lemma 3.2 is therefore complete. □ 

Proof of Theorem 3.2. In view of Lemma 3.2, we only need to give 
the proof of the "if" part. Note that (3.14) implies that 

max \Ui^iVi^iri/2]+i\>n'')<oo 

which is equivalent to 

oo 

^nP(|C/i,iFi,2| >n")<oo. 

n=l 

So it follows that £^|C/i,iVi,2|^/° < oo. Setting Sn = ELi Uk,iVk,2,n> 1 and 
applying the Baum-Katz [4] theorem, we have 

P i sup — ^ > e J < oo for all e > 



n=l 

which implies that 



m>n ITT- 



p(^-^>e^ =o{n~^) foralle>0 

and hence by Ottaviani's inequality, it follows that 

(3.26) max =o(n~^) for all e > 0. 

^ ^ i<i<n V J 
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Since n/pn is bounded away from and oo, there exists a constant c > 1 
such that c~^n <Pn1^ cn,n > 1. Thus (3.13) follows if we can show that 

(3.27) hm ™i<^^.<cnlELi^M^fe..l ^ ^ ^ 

n— ♦oo fi'^ 

For fixed e > 0, set for 1 < /c < 2", 1 < i,j < c2", n > 1, 

yk%, = Uk,iVk,I{\Uk,Vk,j\ > ie/2")2n, 
Yt%, = Uk,iVk^,mk,Vk,,\ < (e/2")2"-). 

Then, for 2"^^ < m < 2",n > 1, 

maxi<i^j<cm I EfcLi Uk,iVk,j\ ^ maxi<i^j<cm | X^fcLi ^fc,n,i,jl 



(3.28) 

TTIQV , I Y^"^ V(^) I 

_^ '-^J^ 



In view of (3.14), by applying Lemma 3.1, we have 



(3.29) PI max max 

\l<m<2"l<iy^j<cm 



m 
k=l 



eventually =1. 



Clearly, recalling £'|?7i,iVi,2p''° < oo, for all 6>0, 

„ , , l^k=l ^k,n,l,2\ e 

max max F > o 



2"-l<m<2" l<i<'m \ m' 

<2"P(|f/i,iVi,2| >(e/2")2"") 
= 0(2-") 

and this, together with (3.26), ensures that, for all 6 > 0, 

/\T^ Y^^^ I \ 
(3.30) max max P ' ^=^ > 6] = 0(2" 

2"-i<m<2" l<i<m \ m° / 



Write Hm,n = niaxi<j<„ '^j,m,n where K,j,m,n is a median of the random vari- 

able |Ei=i^ 
implies that 



able I Ei=i yt^l 1 2l/"i"> 1 < i < "1, 2"-^ < m < 2", n > 1. Note that (3.30) 



lim max n = 0. 

n^oo 2"-i<m<2" ' 

Applying Lemma 3.2 of [10] which is a generalization of the Hoffmann- 
J0rgensen [6] inequalities, it follows from (3.30) that for sufficiently large n 
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and every m G [2"~^ + 1,2"], 



Em -1^(2) I 
k=l fc,n,l,2l 



v^m yA(2) I 

<4(P( '^'=^ >4e 



<64(P( '^'=^ >£ 



Hence 



(3.31) 



OO /-mov , I Y^"l v(^) I 

V- V- pf '^^^l<i^j<cm\l^k=l'^k,n,i,j\ ^ 
n=l2"-i<m<2" 

oo , I y^m T^(2) i 

n=l2"-i<m<2" 
oo 

n=l 
< OO. 

Taking into account (3.29) and (3.31), we conclude from (3.28) and the 
Borel-Cantelli lemma that 

maxi<j^j<cn I Efe=i Uk,iVkj\ 
limsup ~ ■ ^ < lOe a.s. 

n.-»oo 

Letting e j 0, (3.27) follows. □ 

Proof of Theorem 3.3. In view of Lemma 3.2, we only need to give 
the proof of the first part. Note that (3.15) implies that 

V PI max \Ui^iVi [n/2]+i\ > Vnlogn) < oo 

which is equivalent to 



E "--Pdf^i, 1^1,2! > \/nlogn) < 00. 



n=l 
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So it follows that 



^1,1 "^1,: 



V(log(e + |C/i,iFi,2|))V 
Let (5 > be fixed. We choose 1 < q <2 such that 



(3.33) y[qn\ log[gn] < (1 + S)\/nlogn for all sufficiently large n. 
For 1 <k < g", n > 1, set 



4i,i,j = Uk,iVkjI{\Uk,iVk,j\ > {5/2)V¥W¥ 



Then, for ^ < m < g", n > 1, 
ixL ax ]^ < j ^ J < 



\Jm log 



< — — 

^J m log m 



+ 



yjm logm 

.(3) F7(3) 



_^ maxi<i^j<c„, I X)fcLl(^fc,n,i,i ~ -^^fc,n,l,2)l 

\/ m log m ' 

where c > 1 is a constant such that c~^n <Pn1^ cn,n > 1. Note that (3.32) 
ensures that 



max 

q"~^ <m<q" 



m 



k=l 



^ 4E\Ui,iVi,2\^ 

< — pr- > U as n — > oo. 

0^ log 



So, in view of Lemma 3.1, condition (3.15) implies via the Borel-Cantelli 
lemma that 

™aXi<i^j<cm|EfcLl(^M,ij --^^M,l,2)l . . ^ ,1 

F max — < eventually 

(3.34) 

= 1. 

Using the Chebyshev inequality, it follows from (3.32) that for q^~^ <m< 
q"-,n>l and e > 0, 



\J m log m J e'^mlogm 
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(3.35) < 



e2gn/3 logm 



Thus, applying Lemma 3.2 of [10] and using the same argument as in the 
proof of Theorem 3.2, we have that for sufficiently large n and every m G 

^/rn\ogrn 



(2) _ ^^^2) 

(2) _ M X X 2 



^ Vp/IE^U(^ M.i,2-^ ^M,i.2)l^,,A 

V V \/ m log 771 / 

.^fpf I X]Ar=l(^fc^l,l,2 ~ -^^1/1,1,2)1 ^ 22(^^ ^ ^ 

\/ m log m J 
^ a/ m log m 

Em /'7(2) _ 1717(2) Ni 
< 4' I J-'l fc=ll^fc,n,l,2 -^^A:,n,l,2^l ^ 



\/ m log m 

/ / 1 f 



Er=l(41l,2-^41l,2)l ^^^^ 



Hence 



m log TTl 

:o(g-(i6/3)n^ [by (3.35)]. 



pi — ^^'^J^"" I ^w=iV"fc,n,t,j ""fc,n,l,2/i ^ 

n=lqi-i<m<q' 



n=l q"-^<m<q' 
(3.36) 

<£o(g-(^/3)" 

n=l 
< 00. 



V y/ m log m 

(2) 
TTl log m 



<y y .2^2p/^ i^fe=ii^ M.i.2 ^ ^M.1.2^ . ^^^^ 
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Taking into account (3.34) and (3.36), we conclude by the Borel-Cantelli 
lemma that 

(3.37) hmsup max '^^^i<i^i<cra\Y^i Hk^n^ ^ 

n^oo q"-^<m<q^^ ^/mlogm 



where Hk,n,i,j = (4!i,,, " ^4:^,2) + iZlf^ij " ^4:n,i,2)- It is easy to see 
that {EU^^){EV^^) = 1 implies that for ah e > 0, 



.(1) 



.(2) 



max P 

q"-^<m<q"- 



< 



1 



log q 



Em I ryi?) I? '7(3) \ 

fc=ll^fc,n,l,2 ~ ^^k,n,\,2) 

\J m log m 
as n ^ 00. 



> e 



Using the same argument as that used to obtain (3.6) in the proof of Theo- 
rem 3.1, for all large n 



maxi<,^,<,^ I Er=i(41.,, - -^4:^,1.2) I ^ ^ , .,2 
max — — >2(l + 3o) 

q"-^<m<q" ^/mlogm 



'(3) 



Y^iy "J / 7(3) _ 



(3) 



> 2(1 + 25) 



Note that 



[9" 



k=l 

~ as n — > 00, 

,^,|xJ41l,2-i^41l,2l<2^"/^ n>l, 



and 



2(l + 2(^)Vg'^logg"(2g"/3) ^ 
lim = 0. 

Then, applying Lemma 7.1 of [11] which is the classical Kolmogorov expo- 
nential inequalities, we have that for all large n, 



E(^A:,n,l,2 ~ -^-^fc,n,l,2) 
k=l 



>2{l+26)^[q-]log[q- 
< 2exp{-2(l + <5)logg"} = 2g-2(i+^)". 
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Hence 

maxi<.^,<e>.|Er=i(41,,-^41i,2)l , , ,,,2 
> F[ max ^-^-^ — > 2(1 + Jo) 

~^ \q"-^<m<q" ^/mlogm 
oo 

n=l 

and another application of the Borel-Cantehi lemma gives 



lim sup max 



n-»oo (j"-i<m<g" W^mlogm 

(3.38) 

< 2(1 + 35)^ a.s. 

Combining (3.37) and (3.38) and letting 5 | 0, we get 

maxi<j-^,-<cn I J2k=i Uk,iVk j\ 

hmsup ~ ■ — < 2 a.s. 

n->oo V n log n 

The proof of Theorem 3.3 is therefore complete. □ 

Corollary 3.3. Let {Xk^i;k > l,i > 1} be an array of i.i.d. random 
variables. Suppose that n/pn is bounded away from and 00. 

(i) Let a > 1/2. Then 

lim ^^^i<i<pJT.k=iXk,\ ^ Q 

n— >oo 7i<^ 

if and only if E\Xi ip/" < 00 and EXi 1 = whenever a < 1. 

(ii) If 

(3.39) i?Xi,i = 0, £;x2i = l and e( f^'^ ) <oo, 

V(log(e + |Xi,i|))V 

/Q r maxi<i<p„ | I]fc=i^fc,il ^ r, 

(3.40) hmsup — = — <2 a.s. 

n^oo ^yn log n 

Conversely, if 

maxi<j<p„ I X;fc=i^A:,i| ^ 

hmsup ^ = ^ < 00 a.s., 

n^oo v n log n 

then 

EXi^i = 0, EXf-^<(x, and e(—- 1^^— - ) < 00. 

V(log(e + |Xi,i|))2; 

Proof. Set Uk,i = X^^i^Vk^i = 1, k>l,i>l. Then parts (i) and (ii) 
follow, respectively, from Theorems 3.2 and 3.3. □ 
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4. Proofs of the main results. We now give the proofs of the main results. 

Proof of Theorem 2.1. Theorem 2.1 follows directly from Theo- 
rem 3.2. □ 

Proof of Theorem 2.2. Ifl/2<Q!<1, then, in view of Remark 2.1, 
(2.2) implies that EXf -^ < oo. Let fi = EXi^i. Then < = E{Xi^i - fif < 
oo since Xi^i is nondegenerate. Note that for 1 <i <Pn 

n n 

Y^iX,, - V = Ei^k, - f^f - n{xt^ - i,f 

k=l k=l 

and for 1 < i, j < 

n 

Y.{Xu,-Xt'^)[X,,-Xf) 



k=l 



k=l 



By Corollary 3.3, it is easy to see that 



lim n} " max IX-""^ — u\ = a.s., 

n-^oo l<i<p„ 



limn max \X- — zi A,- —u\=U a.s., 

n^oo l<i<i<p„' I r-w J r~\ 



and 



1- ■ r ■ '}lli=l{XkA — X- 

limmf mm ' * 



n^oo l<i<p„ n 

= liminf min ( ^k=iiXk,i-fJ^f _^j^,nj_ y 

r ■ f ■ Y.k=l{Xk,i -/^)^ 
= hm mi mm 

n-»oo l<i<p„ n 

> limmi mm ■ 

n^oo l<i<p„ n 

^^^2,,^ V maxi<,<,„ I ELi(nVfe) - EYl,m\ 

> EYi i[b) — lim sup ■ 

' n— »oo Tl 

= EY^^^{b) a.s., 

where Yk^i{b) = {X^^i — fi)I{\Xk^i — jj.] < b),k > l,i > l,b > 0. Letting 6 t oo, 
we get 



n^oo l<i<p„ n 



liminf min 2.fc=iiAfc,, X^ ) ^ 
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We now show that 

OO / 

(4.1) max |(Xi-^)(X,-^)|>n°) <oo. 



n=l 



Note that 



f;pf max |(X,-^)(X,-^)|>n") 



<yP max |XiX,|>in" 



n=l 

OO 



+ 2^P max |/iXi|>in" 



n=l 

OO 

n=l 



Clearly, 

OO 

n=l 

By (2.2) and Lemma 3.1, 

V max > \n°\ < oo. 

\i<i<j<n 4 y 

Also 



^ PI max I^Xil > j < ^ nP(|/iXi| > ^n") < oo 

n=l V — — / n=l 

since, by Remark 2.1, E\Xi\'^/°^ < oo. Thus (4.1) holds. Hence, applying 
Theorem 2.1, we have 

limsupni-L„ < -1 limsup '^^''^^^<^^p^ ' ^k=iiXk, - ^^){X,, - ^,)\ 

n— >oo CJ n— >oo Ti 

= a.s. 

This completes the proof of Theorem 2.2. □ 

Proof of Theorem 2.3. We first prove that (2.5) implies (2.4). Clearly, 
(2.4) follows from Theorem 3.3 if we can show that 
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To show this, for arbitrary 6 > and k> l,i> 1, set 

Uk^b) = Xk,^I{\Xk^^\ <b)- < b), 

Vk,^{b) = Xk,^I{\Xk,^\ > b) - EXi^^I {\Xi,i\ > b). 

Note that 



Wn > max 



k=l 



2 max 



k=l 



— max 



Y.Vk,imkj{b) 



k=l 



where c > 1 is a constant such that n/c<pn< cn, n>l. Applying Lemma 3.1 
of [7] (since n/[n/c\ — > c S (0, oo)) and our Theorem 3.3, we have 

hminf > hminf I ^^=i ^kAb)Uk,j{b)\ 

n^oo logn ~ n->oo 



2hmsup 



■ynlogn 
maxi<i-^j<„/c I Efc=i Uk,iib)Vkj( 



hmsup 

n^oo 



■y/ n log n 

maxi<^-^j<^/e I ELi ^fc,i(^)Vfcj(^)| 
-y/ n log n 



> 2EUl,{b) - A^EUlAb)^EVlAb) - 2EV,\{b) a.s. 

Letting 6 too, (4.2) follows since 

lim EUf i{b) = l and lim EV^i (&) = 0. 

We now show that (2.4) implies (2.5). In view of Lemma 3.2, Theorem 2.1 
and Remark 2.1, (2.4) imphes that EXi = 0, EXf = < oo and (2.6) (with 
"v/nTogn replaced by a'^\Jn logn ) holds. Hence 



lim 



2a' 



a.s. 



n-^co n log n 

It follows that 2o-2 = 2 and so EXl = 1. Thus (2.5) holds. □ 



Proof of Theorem 2.4. In view of Remark 2.3, condition (2.6) implies 
that EXf^ < oo. Let fi = EXi^i. Then < a"^ = E{Xi^i- fif < oo since Xi i 
is nondegenerate. Applying Corollary 3.3, one can see that 



lim max 

n^oo l<i<p„ 



lim max 

n^ool<i<p„ 

El=i{{Xk,-f^?-a' 



/i| = 



n 



a.s., 



a.s. 
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and 



lim sup 



n 



1/2 



max \xl"'^ — /u| < 2 a.s. 



*oo \lognJ i<j<p„ 

By an argument similar to that in the proof of (4.1), (2.6) and Lemma 3.1 
ensure that 



n=l 



y^Pl max \{Xi — n){Xj — fi)\> (T^ Vnlogn ) < oo. 
~, \i<i<j<n J 



Since, for every i > 1 and j > 1, 



Y^ix,,, - ))(x,,, - ) - Y.{x,,, - ^^){Xk, - fi) 



k=l 



k=l 



<n|xf)-^||x]")-/.|, 



we get 



lim max 

n->ool<j<p„ 



jyk=ii^k,i - X- 



(n)\2 



a 



n 



a.s.. 



lim sup 



nmaxi<.Kp„,i<j<p„ - n\\X'j - ^\ 

-^/nlogn 



lim rnax {X^""^ — fi\ x lim sup 



n^oo l<i<p„ 

= a.s., 
and it follows by Theorem 2.3 that 



n 



n^oo \\lognJ l<j<Pn 



1/2 



max \X> — fi\ 



lim 



n 



V log n 



1/2 



1 maxi<j<j<p„ I Efc=i(^fe,i - - -'^j 

— ^ lim 



■y/ n log n 



1 ^.^ maxi<^<j<p „ I ELi {^k,i - /^) (^fc,j - fJ-) I 



0-2 n^oo -y/ n log n 



= 2 a.s. 
Thus (2.11) has been established. □ 
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